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Abstract. In a continuous time stochastic economy, this paper considers the problem of con- 
sumption and investment in a financial market in which the representative investor exhibits a 
^ , change in the discount rate. The investment opportunities are a stock and a riskless account. 

Q^ , The market coefficients and discount factor switches according to a finite state Markov chain. 

00 ■ 

The change in the discount rate leads to time inconsistencies of the investor's decisions. The 

j->.. . randomness in our model is driven by a Brownian motion and Markov chain. Following [3] we 

introduce and characterize the equilibrium policies for power utility functions. Moreover, they 
are computed in closed form for logarithmic utility function. We show that a higher discount rate 
leads to a higher equilibrium consumption rate. Numerical experiments show the effect of both 

S^ . time preference and risk aversion on the equilibrium policies. 
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1 Introduction 

Dynamic asset allocation in a stochastic paradigm received a lot of scrutiny lately. The first 
papers in this area are [TT] and |12] . Many works then followed, most of them assuming an 
exponential discount rate. [3] has given an overview of the literature in the context of Merton 
portfolio management problem with exponential discounting. 

The issue of discounting was the subject of many studies in financial economics. Several 
papers stepped away from the exponential discounting modeling, and based on empirical and 
experimental evidence proposed different discount models. They can be organised in two classes: 
exogenous discount rates and endogenous discount rates. In the first class the most well known 
example is the hyperbolic discounting. This type discounts near future more heavily than distant 
future which is in accordance with the experimental findings. [3] and [1] discuss about this class 
of discounting. 

The concept of endogenous time preference was developed by [8] in a discrete time formulation. 
|17] considered the continuous time version which was later extended by [6] . The class of discount 
rates emerged in response to the following two observed phenomena: "decreasing marginal impa- 
tience" DMI and "increasing marginal impatience" IMI. DMI means that the lower the level of 
consumption, the more heavily an agent discount the future. IMI is just the opposite: the higher 
the level of consumption, the more heavily an agent discount the future. Some papers support 
DMI, e.g. d], others advocate for IMI, [TB] . 

In this paper we consider a regime switching model for the financial market. This modeling is 
consistent with some cyclicality observed in financial markets. Many papers considered these types 
of markets for pricing derivative securities. Here we recall only two such works, [7] and [5]. In [7], 
the author considers a stock price model which allows for the drift and the volatility coefficients to 
switch according to two-states. This market is incomplete, but is completed with new securities. 
In [5] the problem of option pricing is considered in a model where the risky underlying assets are 
driven by Markov-modulated Geometric Brownian motions. A regime switching Esscher transform 
is used in order to find a martingale pricing measure. When it comes to optimal investment in 
regime switching markets we point to [H]. In their paper they allow for the risk preference to 
switch according to the regime. 

The discount rate in our paper is stochastic, exogenous and it depends on the regime. By 
the best of our knowledge is the first work to consider stochastic discounting within the Merton 
problem framework. In a discrete time model, [16] considers a cyclical discount factor. 

Non constant discount rates lead to time inconsistency of the decision maker as shown in ^ 
and [3]. The resolution is to consider subgame perfect equilibrium strategies. These are strategies 
which are optimal to implement now given that they will be implemented in the future. After we 
introduce this concept we try to characterize it. In order to achieve this goal the methodology 
developed in [3] is employed. That is a new result in stochastic control theory: it mixes the idea of 



value function (from the dynamic programming principle) with the idea that in the future "optimal 
trading strategies" are implemented (from the maximum principle of Pontryagin) . The new twist 
in our paper is the Markov chain, and the mathematical ingredient used is Ito's formula for the 
Markov-modulated diffusions. Thus, we obtain a system of four equations: first equation says 
that the value function is equal to the continuation utility of subgame perfect strategies; second 
equation is the wealth equation generated by subgame perfect strategies; the last two equations 
relate the value function to the subgame perfect strategies. The end result is a complicated system 
of PDEs, SDE and a nonlinear equation with a nonlocal term. The investor's risk preference in 
this model is of CRRA type which suggest an ansatz for the value function (it disentangles the 
time, the space and the Markov chain state component). This result in subgame perfect strategies 
which are time/state dependent and linear in wealth. In the special case of logarithmic utility we 
can compute them explicitly. If constant discount rates, we notice that subgame perfect strategies 
coincide with the optimal ones. 

The goal of this paper is twofold: first, to consider a model with stochastic discount rates 
and second, to study the relationship between consumption and discount rates (which resembles 
IMI and/or DMI ). In the Merton problem with constant discount rates we show that higher 
the discount rate higher the consumption rate (this is somehow an inverse relationship to IMI). 
We explore this relationship in our model with stochastic discount rates. Numerical experiments 
revealed that the consumption rate is higher in the market states with higher discount rate. We 
provide an analytic proof of this result for the special case of logarithmic utility. This result 
is somehow consistent with the discount rate monotonocity of consumption rate in the Merton 
problem. It can also explain the IMI effect: if we observe the consumption rate, then a possible 
upside jump can be linked to a jump in the discount rate and vice versa. The effect of risk aversion 
on the consumption rate is analysed. Here the results are consistent with |llj and [12]. That is 
consumption rate is increasing in time for most levels of risk aversion except at very high levels 
when is decreasing ( this can be explained by the investor's increased appetite for risk which leads 
to more investment in the risky asset and a deceasing consumption rate). 

The reminder of this paper is organized as follow. In section 2 we describe the model and 
formulate the objective. Section 3 contains the main result under the power utility and logarithmic 
utility. In section 4, we present the numerical results. Section 5 examines consumption versus 
discount rate. The paper ends with an appendix containing the proofs. 

2 The Model 

2.1 The Financial Market 

Consider a probability space {Q,{J-t}o<t<TTJ',^), which accommodates a standard Brownian 
motion W = {W{t),t > 0} and a homogeneous finite state continuous time Markov Chain (MC) 



J = {J{t),t > 0}. For simplicity assume that MC takes values in 5 = {0,1}. Our results hold 
true in the more general situation of S having finitely many states. The filtration {J-t}o<t<oo is 
the completed filtration generated by {l^(i)}iG[o,oo) ^^^ {"^(^)}te[o,oo)) that is Tt = F^ \J F^ . 
We assume that the stochastic processes W and J are independent. The MC J has a generator 
A = [Ajj]5x5 with \ij > for i 7^ j, and Xl/eS ^v ~ ^ ^^'^ every i £ S. 

In our setup the financial market consists of a bank account B and a risky asset S, that are 
traded continuously over a finite time horizon [0, T] (here T G (0, oo) is an exogenously given 
deterministic time). The price process of the bank account and risky asset are governed by the 
following Markov-modulated SDE: 

dB{t) = r{t,J{t))B{t)dt, 

dS{t) = S{t) [a{t, J{t)) dt + a{t, J{t)) dW{t)] , < f < oo, 

where B{0) = 1 and ^(O) = s > are the initial prices. The functions r{t, i),a{t, i),a{t, i) : f € 5, 
are assumed to be deterministic, positive and continuous in t. Given the state i of the MC at t 
they represent the riskless rate, the stock volatility and the stock return. Moreover 

/i(t, i) = a{t, i) — r{t, i) 

stands for the stock excess return. 

2.2 Investment-consumption strategies and wealth processes 

In our model, a representative investor continuously invests in the stock, bond and consumes. An 
acceptable investment-consumption strategy is defined below: 

Definition 2.1. An M?-valued stochastic process {u{t) := (vr(t), c(t))}(gro^oo) ^-5 called an admis- 
sible strategy process and write u € A if it is Ft— progressively measurable and it satisfies the 
following integrability condition 

E[ \TT{s)^j,{s,J{s))-c{s)\ds+ \TT{s)a{s, J{s))\'^ ds] < oo, a.s., for all t e[0,oo). (2.1) 
Jo Jo 

Here 7r(t) stands for the dollar value invested in stock at time t and c(t) > for the consump- 
tion. X^{t) := X{t) represents the wealth of the investor at time t associated with the trading 
strategy u; it satisfies the following stochastic differential equation (SDE) 

dX{t) = {r{t,J{t))X''{t) + fi{t,J{t))7r{t)-c{t))dt + a{t,J{t))TT{t)dW{t), (2.2) 

where X(0) = rr > is the initial wealth and Jq = i G 5 is initial state. This SDE is called 
the self-financing condition. Under the regularity condition (j2.ip imposed on {vr(t),c(t)}(gro^oo) 
above, the SDE (j2.2p admits a unique strong solution. In the end of this section, we introduce 
further assumptions. 



Assumption 2.2. The utility function of the investor is of CRRA type, i.e., 

U{x) = — 

7 

where 7 < 1,7 7^ 0. 

Thus, the inverse marginal utihty function is 

I(x)4(C/')-^(x) = x^. (2.3) 

Assumption 2.3. For any risk aversion level 7 < 1, the following inequalities hold 

E sup \X{t)[< <oo. (2.4) 

te[o,T] 

E sup |c(t)P < 00. (2.5) 

tG[0,T] 

2.3 The discount rate 

As we mentioned in the introduction, this paper considers stochastic discount rates. An easy way 
to achieve this is to let the discount rate depend on the state of MC. Thus, at some intermediate 
time t € [0, T] the discount are is pj(t), for some positive constants po and pi. The intuition of this 
way of modeling discount rate stems from the connection between market state and discount rates 
(this can be explained by some models with endogenous discount rate which may be influenced 
by economic factors). 

2.4 The Risk Criterion 

In our model, the investor decides what investment/consumption strategy to choose according to 

the expected utility risk criterion. Thus, investor's goal is to maximize utility of intertemporal 

consumption and final wealth. The novelty here is that we allow investor to update the risk 

criterion and to reconsider the optimal strategies she/he computed in the past. This will lead to a 

time inconsistent behavior as we show below. Let the agent start with a given positive wealth x, 

and a given market state i, at some instant t. The optimal t— trading strategy {7ft(s), ct{s)} g^u^x] 

is chosen such that 

rT 

e-M^-t)U{c{u)) du + e-P^^^-^^UiX{T))\X{t) = x, J{t) = i 



supE 



t 

T 

e-M^~i)U{ctiu)) du + e-''»(^-*)t/(A(r)) 



^x,^ 



Throughout the paper we denote E^'* [] = E [| A(t) = x, J{t) = i] . The optimal t— trading strategy 
{Trt{s),ctis)}s£[t,T] is derived by the supermartingale/martingale principle. This leads to the 



Hamilton-Jacobi-Bellman (HJB) equation 
dV 



ds 



{t, s,x,i) + sup 



dV,. .. 1 2 2d'^V ■ 



{rx + fiTT - c) — {t, s, X, i) + -a TT -^-^(i, s, x, i) + U{c) 



-piV{t,s,x,i) + ^XijV{t,s,x,j) = 0, 



(2.6) 



with the boundary condition 



V{t,T,x,i) = U{x). 



(2.7) 



Here i stands for the value of MC at time t. Thus, the HJB depends on the current time t ( through 
Pi) and this dependence is inherited by the t— optimal trading strategy. This in turn leads to time 
inconsistencies. The resolution is to introduce subgame perfect equilibrium strategies. They are 
optimal now given that they will be implemented in the future. 



3 The Main Result 



3.1 The subgame perfect trading strategies 



For a policy process {u{t) = Tr{t), c(t)}ig[o,T] satisfying (12. ip and its corresponding wealth process 
{X{t)}f^[QX] given by ()2.2p . we denote the expected utility functional by 



J{t,x,i,TT, c) = E' 



A_ i^X'jZ 



T 



-ft(«-t)[/(c(s)) ds + e-P^^^-'^U{X{T)) 



(3.8) 



Following [3] we shall give a rigorous mathematical formulation of the equilibrium strategies in 
the formal definition below. 

Definition 3.1. Let F = (Fi, F2) : [0, T] x i?+ x S ^ R^ x S be a map such that for any t,x > 

and i £ S 

hm i,f^(^.^.^>^i>^2)-J(t,x,.,vr.,cJ ^ 

£4.0 e 

where 

J{t,x,i,Fi,F2) = J{t,x,i,Tt,c), 

7r{s)^Fi{s,X{s),J{s)), c{s)^F2{s,X{s),J{s)), (3.10) 

and {T^is),c{s)}s^[t^T] satisfies (|2.ip . Here, the process {X{s)}s^[t^x] 'i-s the wealth corresponding 
to {7f(s), c(s)}5g[(j^]. The process {7re(s), Ce(s)}5g[j -7^] is another investment-consumption strategy 
defined by 

^7f(s), se[t,T]\E,^t 
7r(s), s G £',,i, 



vre(s) = < 



(3.11) 



CAS 



(3.12) 



c(s), se[t,T]\E,^t 
c{s), s G E^^t, 

with E^^t = [t-ii + e]; {'^{s)-,c{s)}seEt,t ^* ^^?/ trading strategy for which {T^e{s)-,Ce{s)}s£[t,T] ^^ o,n 
admissible policy. If (|3.9p /lo/c/s ^riie, i/ien {vr(s),c(s)}5gr4 7^i is a suhgame perfect strategy. 



3.2 The value function 

Our goal is in a first step to characterize the subgame perfect strategies and then to find them. 
Inspired by [3], the value function v satisfies 



v{t,x,i) = K\ 



x,t 



T 



-pd^-i)UiF2{s, X{s), J{s))) ds + e-P^^^-'^U{X{T)) 



(3.13) 



Recah that {-'^(•s)}s6[o,t] is the weahh process corresponding to {vr(s), c(s)}sg[(^T]) so it solves the 
SDE 

dXis)=[r{s, J{s))X{syrfxis, J(s))Fi (s, X(s), J(s))-F2(s, X{s), J{s))]d»i<7{s, J(s))Fi (s, X(s))dVl^(s), 

(3.14) 
Moreover, F = {Fi,F2) is given by 



^'«.-) - - ;|:: :;!;;::!) ■ ^^C'-^) - ' (£<'■-) • ■ * ^ i»>^i- 



(3.15) 



Thus, the value function is characterized by a system of four equations: one integral equation 
with nonlocal term (j3.13p . one SDE (|3.14|) and two PDEs (|3.15|) . Of course the existence of such 
a function v satisfying the equations above is not a trivial issue. We will take advantage of the 
special form of the utility function to simplify the problem of finding v. We search for: 



v(t,x,i) = g(t,i) — , X > 0, 

7 



(3.16) 



where the function g(t, i) is to be found. We consider the case 7 7^ (the case of logarithmic 
utility will be treated separately). In the light of equations (j3.15p one gets 



Fi{t,x,i) 



fj,{t,i)x 



F2{t,x,i) =fi(T-i(i,z)x. 



a2(t,i)(l-7) 
By p.l4p . the associated wealth process satisfies the following SDE: 

^2(,,J(s)) 



dX{s) 



r{s,J{s)) 



ct2(s,J(s))(1-7) 
^(^"^^^)) Xis)dW{s). 



g'y-^{s,J{s)) 



X{s)ds 



a(s,J(s))(l-7) 



(3.17) 



(3.18) 



This is a linear SDE which can be easily solved. By plugging v of ()3.16p into (j3.13p (with 
Fi,F2 of (j3.17p and X of (j3.18p . we obtain the following equation for g{t, i), f € 5 : 

^{t,i) + [jr{t,i) + 2a2^^t!i){l^-j) ~ PMt,i)+J2^^^9{tJ) + (1 - l)9^Ht,i) = 0, (3.19) 

with the final condition g{T, i) = 1. Next we show that there exists a unique solution of this ODE 
system. Let us summarize these findings: 

Lemma 3.2. There exists a unique continuously differentiahle solution g{t, i),i ^ S of the system 
i3.19\) . Furthermore, v{t,x,i) = g{t,i)^^ is a value function, meaning that v solves i3.13\) with 
Fi,F2 of [3A7\ ) and X of [3A8\) . 



Appendix A proves this Lemma. 

D 

The following Theorem states the central result of our paper. 

Theorem 3.3. Suppose that v{t,x,i) is given by l[3.16\) with g{t,i),i G S the solution of the 
system /i3.19\) . Let X be the solution of SDE (I3.18p . Then {vf(t), c(t)}sg[o,Tl given by 

nt)= 2u'i%]^^'\ ^ -cit)=9^^{t,J{t))X{t), (3.20) 

(T^(t, J(t))(l -7) 

is a subgame perfect strategy. 

Appendix B proves this Theorem. 

D 

Remark 3.4. In the case of constant discount rate, i.e., po = Pii the subgame perfect strategies 
coincide with optimal ones. This can be seen by looking at the integral equation ()6.34p which is 
exactly HJB (j2.6p (after the first order conditions are implemented). 

Next we turn to the special case of logarithmic utility. 

3.3 Logarithmic Utility 

When the risk aversion 7 = 0, we search for the value function v of the following form: 

v{t, X, i) = h{t, i) log(a;) + l{t, i). (3.21) 

Arguing as in the previous subsection we find that the functions /i, Z : [0, T] x 5 — > R^ should 
satisfy the following system of equations: 

dh 

— (t,i)-pihit,i) + ^A,,Mi,i) + 1 = 0, (3.22) 



|^(t,i) + {r{t,i) + ^-^^)h{t,i) - logl{t,i) - p,l{t,i)+Y,X^jl{t,j) -1 = 0, 

with the final conditions h{T,i) = 1 and l{T,i) = 0. Notice that h solves a linear ODE system 
and it can be found explicitly. With h known, / also solves a linear ODE system. The subgame 
perfect strategy {vr(t), c(t)}5g[o.r] is given by 

7f(t) = Fi(t, J{t))X{t)), c{t) = F2{t, J{t))X{t)), (3.23) 

with 

Fi(t,a;,i) = 4^, F2{t,x,i) = h~\t,i)x. (3.24) 

Next we want to explore the relationship between subgame perfect consumption and discount 
rate. The following lemma shows that the higher discount rate the more consumption. 

Lemma 3.5. Assume that po > pi, and h : [0,T] x 5 — > R'^ solves the linear ODE 113. 22\) . Then 
F2{t,x,0) > F2{t,x,l) for any x > 0. In other words the subgame perfect consumption rate is 
higher in the states in which the discount rate is higher. 

Appendix C proves this Theorem. 

D 

4 Numerical Analysis 

In this section, we use Matlab's powerful ODE solvers (especially the functions ode23 and ode45) 
to perform numerical experiments. We numerically solve ODE system (|3.19p and this in turn 
yield the subgame perfect strategies. Let the market coefficients be pi = 0.15, p2 = 0.15, ai = 
0.25, 0-2 = 0.25, ri = 0.05, r2 = 0.05; 7 = 0.7,0, -0.5 and -1, the discount rate pi = 0.9, p2 = 
0.3. We take the Markov Chain generator to be 

/ -6.04 6.04 \ 
y 10.9 -10.9 J 

Next, define the consumption rate by 

F2it,Xit),J{t)) 1 

C{t, J{t)) := — = 5^-1 [t, J(t)), 

with the functions g{t, i) for i = 1, 2 being the solution of ()3.19p . 
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Fig. 1 

Fig. 1. Equilibrium proportion of wealth consumed for different 7 and p. The x axis represents 
the time, and the y axis the consumption rate C. 

Remark 4.1. Ast ^T consumption rate approaches 1 as it was to be expected. From the picture 
with 7 = 0.7, we can see that the consumption rate decreases with time. This is explained by the 
fact that the higher 7, the less risk aversion, which leads to higher proportion of wealth invested 
into stock and less consumption. This is consistent with a graph from 111^ . We see from the 
graphs that consumption rate increases when 7 increases (this is also consistent with graphs from 
Ul^ ). For a given risk aversion level 7, a higher discount rate will result in higher consumption 
rate. The difference in the consumption rates in the two MC states is decreasing with respect to 
7- 

5 Consumption versus Discount Rate 

We were able to prove for the case of logarithmic utility that higher discount rates lead to higher 
consumption rates. Numerical evidence suggest that this is also true for general power utilities. 
On the other hand, in a model with constant discount rate the same result holds true as the 
following Lemma shows. 
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Lemma 5.1. Let C{t),t € [0, T] be the optimal consumption rate in a model with constant discount 

rate p. Then 

dC{t) 



dp 

Appendix D proves this Theorem. 



>0, i€[0,r]. 



D 



6 Appendix 

6.1 Ito's formula for Markov Chain modulated diffusions 

Suppose the stochastic processes X{t) satisfies the SDE 

dX{t) = p{t, X{t), J{t))dt + a{t, X{t), J{t))dW{t) 

X{0) = x,a.s., 
for some x e R, and G{-, •, i) G C^'^([0, T] x R) for each i G S. Then 

G{t,X{t),J{t)) = G{0,x,J{0))+ [ TG{s,X{s),J{s))ds 

Jo 

BC 

+ — {s, X{s), Jis))a{s, X{s), J{s))dW{s) 

ft 



V / {G{s, X{s), J{t)) - G{s, X{s),i))dM{t), 
TIT,. Jo 



where 

dG dG 1 d^G 

TG{t,x,i) = —{t,x,i) + p{t,x,i) — {t,x,i) + 2'^^^*'^'^)"^ + '^>^ij{G{t,x,j) -G{t,x,i)). 

j€S 

Here M{t), t £ [0,T] is the martingale process associated with the Markov Chain. 

6.2 A Proof of Lemma [3:2] 

The existence of a unique solution g of ODE system p.l9p is granted locally in time by a fixed 
point theorem. If we can establish estimates for g then this local solution is also global solution. 
Let us introduce the process {M{v),v ^ t} by 

(guiu, Ju) + ^ Xj^jg{u,j))du, (6.25) 

J 65 
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with g of (|3.19p . Dynkin formula implies that the process {M{v),v ^ i} defined by (j6.25p is a 
martingale. Further let 

/i2(n,J(n))7 



K{v) = exp < / 
By product rule 

d{K{v)g{v,J„)) = K{v) 



/i2(i;, J„)7 



(6.26) 



dg{v, J^) + g{v, J^) 'yr{v, J^) + 



2a2(z;,J,)(l-7) 



PJu dv 



K{v)[dM{v) + (7 - l)g^^{v, J^)dv]. 



(6.27) 



(6.28) 



(6.29) 



Boundedness assumption on market coefficients makes the process {K{v),v ^ t} of (|6.27|) bounded. 
This in turn yields that g{t, i) is uniformly bounded from below. Next we want to prove that is 
also bounded from above. For a vector y = {yi,y2, ■■■,yn) in R" we introduce the || • ||i norm by : 



Integrating (j6.27p from t to T, we get 

K{T)-g{t,Jt)= I K{v)dM{v) + {^-l) f K{v)g^^ {v, J,)dv. 
Jt Jt 

Taking expectation on the both sides of (j6.28p and letting Jt = i, it leads to 

T 



g{t, i) = ¥.\K{T) + (1 - 7)IEJ / K{v)g—^{v, J,)dv. 



y \\i=^\yi 



i=l 



When 7 is positive ()6.29p yields an upper bound on g (since g is bounded from below). When 
7 < 0, because < -^ < 1 we get from ()6.29p that 



Thus, 



g{t, 0) < E^tK{T) + £0(1 - j) J K{v)g{v, J„)dv. 
g{t, 1) < KJK{T) + £1(1 - 7) y K{v)g{v, J„)dv. 

\\g{t,-)\\i<2K + {l-j)K f \\g{v,-)\\idv, 



(6.30) 
(6.31) 



for some positive constant K. Gronwal's inequality yields an upper bound on g. Next we prove 
uniqueness of the solution of ()3.19p . Indeed, let gi and 52 be two solutions of ()3.19p . then by 
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([09]) it follows that 

\gi{t,i)-g2{t,i)\ = (1-7)K/ Kiv)gr'iv,Jv)dv-El I K{v)g--\v,J,)dv\ 



1 7 rl 7 



<nj K{v)\gt~\v,J,)-gt~'{v,.h)\dv 

< CiEi f K{v)\gi{v, J„) - g2{v, J„)\dv 

< C2KI / \gi{v, Jy) - g2{v, Jv)\dv 

<C2 i\giiv,i) -g2{v,i)\ + \gi{v,j) -g2iv,j)\)dv 

= C2J \\gi{v,-)-g2{vr)\\idv, (6.32) 



for some positive constants Ci and C2. Consequently 



||ffi(t,-)-52(t,-)ll -^^^ j \\gi{vr)-92{v,-)\\dv. 
Thus, by Gronwal's inequality it follows that 

gi{tr) = 92{t,-). 

Next we want to prove that v{t, x, i) = g{t, i)— is a value function, i.e., v solves ()3.13p with Fi, F2 
of (I3.17P and X of (I3.18p . Since the function v is sufficiently differentiable, we can compute the 
derivative of v. 

vt{t,x,i) = gt{t,i) — , v^{t,x,i) = g{t,i)x'^~^, Vxx{t,x,i) = (7 - l)g{t,i)x'^~^ . 

7 

Next we show that v solves the PDE system (j6.34p (which Lemma [6.11 shows that is equivalent to 
(|3.13p ). Substituting the above derivatives into the equation (j6.34p yields 

^(t,z)- + [(r(t,f)x + M*,^m(i,x,i)-F2(t,x,i))g(i,i):E^-i + ^^^^L|^ 

+U{F2{t, x, i))] + V K,g{t, i)— - pig{t, i)— = 0. (6.33) 

After cancelation of x'^ we recover the ODE system ()3.19p : hence v solves (j6.34p (and also ()3.13p ). 

D 
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6.3 B Proof of Theorem [Ml 

We need the following Lemma which gives a PDE version of (|3.13p . 

Lemma 6.1. For a given i (^ S, assume there exists a function v : [0, T] x R^ x S ^ R of class 
C^'^ which satisfies (j3.13p . Then v solves the following equation 

dv , , , , . , ,„, , ^, ^.dv , , a'^(t,i)F?(t,x,i) d'^v , 

— it,x,i) + {r{t,i)x + fi{t,z)Fi{t,x,i)-F2it,x,i)) — it,x,i)+ ^ ' ^t,x,i) 

+ C/(F2(i, X, i)) + Y^ Xijvit, xj) - piv{t, X, i) = 0, (6.34) 

with the boundary condition v{T,x,i) = U{x). 

Proof: We rewrite equation (|3.13p as 

rT 
v{t,x,i)= e-P^^'-^^f{t,s,x,i)ds + e-P^^^-^^h{t,x,i), (6.35) 



where 

fit, s, X, i) ^ W.r[U{F2{s,X{s), J{s)))\, h{t, X, i) ^ E?-'*[C/(X(r))]. 

For a fixed time s, the process {/(t, s,X(t), J(t))}o<t<s is a martingale. Thus, in the light of 
(|3.14p the function /, h satisfy the following PDEs : 

df df 

— {t,s,x,i) + {r{t,i)x + iJ,{t,i)Fi{t,x,i) - F2{t,x,i)) — {t,s,x,i) 

+ ^'(^'^)-^i'(^'^'^) g(t,g,a;,i) + ^A,,/(t,x,j) = 0,/(t,t,x,i) = [/(F2(t,x,i))(6.36) 

-—-{t,s,x,i) + {r{t,i)x + ij{t,i)Fi{t,x,i) - F2{t,x,i))--{t,s,x,i) 
at ox 



a'^(t,i)F?(t,x,i) d'^h . . v^ , ,, , , ,_ n ^w s , ^^ 

+ 2 ' -Q^{t,s,x,i) + Y.Xijh{t,x,j) = 0, h{T,x,i) = Uix). (6.37) 

By differentiating ()6.35p with respect to t we get 



-^{t,x,i)= f e-P^^'~''^-^{t,s,x,i)ds + e-P^^'^-''^ — {t,x,i)+piv{t,x,i)-f{t,t,x,i). (6.38) 



Moreover 



^{t,x,i) = I e-''»(^-*)|^(t,s,x,i)ds + e-^'(^-*)|^(t,rE,i). (6.39) 



£(t, X) = j^ e--(^-) g(i, ., X, .) ds + e--(^-*) g(t, X, .) 



(6.40) 
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In the light of (I06l) . (fOTl) . (lOHD . (fOOD and dOOjl it follows that 



— {t,x,i) + {r{t,i)x + fi{t,i)Fi{t,x,i)-F2{t,x,i)) — {t,x,i)+ ^ ' ^^^ {t,x,i) 

+U{F2{t,x,i)) +'^Xijv{t,xJ) - piv{t,x,i) = 0. 
J65 



D 



Let us move to the proof of the Theorem 13.31 First let us show that 

vf(t) = Fi(i, J(t),X(t)) = 2(fj!^^l]^^*\ , m = F2{t,J{t)),X{t)) = g^{t,J{t))X{t), 

a^(t,J(t))(l-7) 

(6.41) 
is admissible and it satisfies (|2.4|) and (|2.5|) . This claim follows easily since X of (|3.18|) has finite 
moments of any order. Next, let us define 

0y I I Qy \ \ 0y 

rv{t,x,i) = —{t,x,i)+ir{t,i)x-li—{t,x,i)jj—{t,x,i) 

- £Ms%^7r^ + E^^Mt,^,^)-vit,x,J)) + U{c). (6.42) 

r'^'^'f (t, X, i) = —{t,x,i) + {r{t,i)x-fi{t,i)7r-c)—{t,x,i) 

+ -a\t,i)Tr^-^{t,x,i) + Y,>'ijHt,x,i) -v{t,x,j)) + U{F2{t,x,i)).{6A3) 

Then by the concavity of v and the first order conditions it follows that 



Tv{t,x,i) = maxV^'^v {t,x,i), {Fi{t,x,i),F2{t,x,i)) = argmaxT'^'^'f (i,x,i). (6.44) 

{n,c} {7r,c} 

Moreover, equation (I6.34p can be written 

Tv(t,x,i) = piv{t,x,i). (6.45) 

Let us recall that 

J{t,x,i,Fi,F2) = v{t,x,i). (6.46) 



15 



Thus 



J{t,x,i,Fi,F2) - J{t,x,i,7r^,Ce 

t+e 



^x,i 


jgX, 


^x,i 



-P^(^-*)[U{F2{s,X{s),J{s)))-U{c{s))]ds 



-Pi{s-t)\ 



e -- ^'[U{F2{s,X{s),J{s)))-U{c{s))]ds 



t+e 



-M'^-t){U{X{T))-U{X{T))) 



In the Hght of inequahties ()2.4p and (j2.5p and Dominated Convergence Theorem 



(6.47) 



Hm- 

eJ-O 



^x,* 



jt+e ^_p,(,„t) p^F2is,Xis), Jis))) - Uicis))] ds 



U{F2{t,x,i)-U{c{t)). 



In the Hght of (f06]) it fohows that 
rT 



Ef 



-p,(s-i)r 



e -- ^^[C/(F2(s,X(s),J(s)))-C/(c(s))](is 



t+e 



+ E? 



-p.(2^-«)(f/(x(r))-c/(x(r)))' 



E^'^ [i;(t + e,X(t + e), J{t + e)) - v{t + e, X(t + e), Jit + e) 



E, 



E, 



E[ / (e-''»(^-*) - e-P-n^+^)^'''^)[U{F2{s,X{s), J{s))) - U{F2{s, X{s), J(s)))] ds 



t+e 



]E[(e-ft(r-t) _ e-^^(*+-)(^-*+^))[c/(x(r)) - [/(x(r))] 



(6.48) 



In the hght of inequahties (|2.4p , (j2.5p and Dominated Convergence Theorem it fohows that 



E? 



hm- 

eiO 



\e-P^{T-t) _ e-^J(*+-)(^-*+^))[f/(X(T)) - UiX{T))] 



= Aij-(e-^»(^-*) - e-P^^'^-'^)Ef [[U{X{T)) - U{X{T))]\ = 0. 
By the same token one can get that 



hm- 



E^'* 



J^^^(e-P.(.-t)_e-P..(*+.){-t))[[/(i7^2(s,X(.),J(.)))-[/(F2(s,X(s),J(s)))](i. 



£4-0 
Ito's formula yields 



0. 



Ef [v{t + e,X{t + e), J{t + e)) - v{t + e, X{t + e), J{t + e) 



E? 



i+£ 



[r7;(s, X(s), Jis)) - UiF2is, Xis), J(s))]ds - E^'* / [r7;(s, X(s), Jis)) - [/(c(s))]ds 



i+e 



Therefore 
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J{t,X,i,Fi,F2)- J{t,X,i,TT^,Ce) .= , .. , -M ^ n 

lim = [Tv[t, X, I) — Tvit, X, i)\ > 0, . 

the inequality follows from ()6.44p . 

6.4 C Proof of Lemma 13.51 

We know that h{t, i) solve the ODE system 

— (t, 0) + (All - Po)h{t, 0) + Ai2/i(t, 1) + 1 = 0, 
ot 

dh 

— (t, 1) + (A22 - Pi)h{t, 1) + \2ih{t, 0) + 1 = 0. 
ot 

Let us define h[t) = h{t, 0) — h{t, 1), then h satisfies the following ODE: 

h'{t) + (All + A22 - po)h{t) - {po - pi)h{t, 1) = 

Under the assumption po > pi, one gets 

h'{t) + {Xii + X22-po)h{t) >0. 

From here it follows that h{t) < 0, on [0,r) (since h{T) = 0). Hence, h{t,0) < h{t,l). Conse- 
quently F2(t,x,0) > F2{t,X,l). 

D 

6.5 D Proof of Lemma 15.11 

Here we are in the case of po = pi = p- Further, for simplicity we assume constant market 
coefficients a and a. The optimal consumption rate is 

_ r (a-r)2 , 

where rj = ^\_J"'^ • It follows from direct computations that 

dp City (i-7)r?2^ r?2(i-7) J ^"■'^''^ 

If 1 + i]{r] — l){t — T) < the claim follows. Otherwise, since 

eViT-t) yl^^(T-t)>l + 7?(r -t) + ifit - T), 
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it follows that 

whence the result. 

D 
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